Pandas Profiling Report

Dataset statistics

Number of variables	11
Number of observations	5703
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	534.7 KiB
Average record size in memory	96.0 B

Variable types

Numeric	11

Alerts

`gross_revenue` is highly correlated with `qtd_purchases` and 1 other fields	High correlation
`qtd_purchases` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`qtd_products` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`avg_products` is highly correlated with `qtd_products` and 1 other fields	High correlation
`avg_unique_products` is highly correlated with `avg_products`	High correlation
`recency_days` is highly correlated with `customer_id`	High correlation
`purchase_frequency` is highly correlated with `qtd_purchases`	High correlation
`qtd_cancelled_products` is highly correlated with `qtd_products` and 2 other fields	High correlation
`cancelled_over_purchased` is highly correlated with `qtd_cancelled_products`	High correlation
`customer_id` is highly correlated with `recency_days`	High correlation
`gross_revenue` is highly skewed (γ1 = 23.72814196)	Skewed
`mean_ticket` is highly skewed (γ1 = 46.60155412)	Skewed
`qtd_products` is highly skewed (γ1 = 23.07183204)	Skewed
`avg_products` is highly skewed (γ1 = 48.56980066)	Skewed
`qtd_cancelled_products` is highly skewed (γ1 = 52.07018364)	Skewed
`customer_id` has unique values	Unique
`qtd_cancelled_products` has 4200 (73.6%) zeros	Zeros
`cancelled_over_purchased` has 4200 (73.6%) zeros	Zeros

Reproduction

Analysis started	2022-11-23 22:18:17.651921
Analysis finished	2022-11-23 22:18:43.851409
Duration	26.2 seconds
Software version	pandas-profiling v3.4.0
Download configuration	config.json

customer_id
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	5703
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	16602.87585

Minimum	12346
Maximum	22709
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	12346
5-th percentile	12697.3
Q1	14287.5
median	16229
Q3	18214
95-th percentile	21746.6
Maximum	22709
Range	10363
Interquartile range (IQR)	3926.5

Descriptive statistics

Standard deviation	2811.617168
Coefficient of variation (CV)	0.1693451901
Kurtosis	-0.8238803827
Mean	16602.87585
Median Absolute Deviation (MAD)	1964
Skewness	0.4409657161
Sum	94686201
Variance	7905191.098
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
14383	1	< 0.1%
21091	1	< 0.1%
17123	1	< 0.1%
17891	1	< 0.1%
16498	1	< 0.1%
13745	1	< 0.1%
15584	1	< 0.1%
21089	1	< 0.1%
21088	1	< 0.1%
Other values (5693)	5693	99.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
12346	1	< 0.1%
12347	1	< 0.1%
12348	1	< 0.1%
12349	1	< 0.1%
12350	1	< 0.1%
12352	1	< 0.1%
12353	1	< 0.1%
12354	1	< 0.1%
12355	1	< 0.1%
12356	1	< 0.1%

Value	Count	Frequency (%)
22709	1	< 0.1%
22708	1	< 0.1%
22707	1	< 0.1%
22706	1	< 0.1%
22705	1	< 0.1%
22704	1	< 0.1%
22700	1	< 0.1%
22699	1	< 0.1%
22696	1	< 0.1%
22695	1	< 0.1%

gross_revenue
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	5458
Distinct (%)	95.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1719.97418

Minimum	0
Maximum	278778.02
Zeros	7
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	0
5-th percentile	12.596
Q1	230.52
median	603.42
Q3	1544.88
95-th percentile	5190.786
Maximum	278778.02
Range	278778.02
Interquartile range (IQR)	1314.36

Descriptive statistics

Standard deviation	7360.945437
Coefficient of variation (CV)	4.279683685
Kurtosis	740.6201671
Mean	1719.97418
Median Absolute Deviation (MAD)	473.97
Skewness	23.72814196
Sum	9809012.75
Variance	54183517.73
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
7.95	9	0.2%
1.25	8	0.1%
2.95	8	0.1%
4.95	8	0.1%
12.75	7	0.1%
1.65	7	0.1%
0	7	0.1%
3.75	7	0.1%
5.95	6	0.1%
7.5	6	0.1%
Other values (5448)	5630	98.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	7	0.1%
1.776356839 × 10^-15	1	< 0.1%
3.552713679 × 10^-15	2	< 0.1%
1.065814104 × 10^-14	1	< 0.1%
5.684341886 × 10^-14	1	< 0.1%
0.42	1	< 0.1%
0.65	1	< 0.1%
0.79	1	< 0.1%
0.84	4	0.1%
0.85	3	0.1%

Value	Count	Frequency (%)
278778.02	1	< 0.1%
259657.3	1	< 0.1%
189735.53	1	< 0.1%
133007.13	1	< 0.1%
123638.18	1	< 0.1%
114505.32	1	< 0.1%
88138.2	1	< 0.1%
65920.12	1	< 0.1%
62924.1	1	< 0.1%
59419.34	1	< 0.1%

mean_ticket
Real number (ℝ_≥0)

SKEWED

Distinct	5508
Distinct (%)	96.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	28.22121083

Minimum	0
Maximum	9904.875
Zeros	7
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	0
5-th percentile	3.3502
Q1	7.821939589
median	15.22257143
Q3	21.20793145
95-th percentile	71.26302198
Maximum	9904.875
Range	9904.875
Interquartile range (IQR)	13.38599186

Descriptive statistics

Standard deviation	158.8876329
Coefficient of variation (CV)	5.630078519
Kurtosis	2707.395005
Mean	28.22121083
Median Absolute Deviation (MAD)	7.041078891
Skewness	46.60155412
Sum	160945.5654
Variance	25245.27989
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
3.75	11	0.2%
4.95	10	0.2%
1.25	9	0.2%
2.95	9	0.2%
7.95	8	0.1%
1.65	7	0.1%
0	7	0.1%
12.75	7	0.1%
8.25	7	0.1%
5.95	6	0.1%
Other values (5498)	5622	98.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	7	0.1%
1.758769148 × 10^-17	1	< 0.1%
8.07434927 × 10^-17	1	< 0.1%
2.537652628 × 10^-16	1	< 0.1%
4.844609562 × 10^-16	1	< 0.1%
1.894780629 × 10^-15	1	< 0.1%
0.36	1	< 0.1%
0.42	3	0.1%
0.535	1	< 0.1%
0.65	1	< 0.1%

Value	Count	Frequency (%)
9904.875	1	< 0.1%
3861	1	< 0.1%
3096	1	< 0.1%
1687.2	1	< 0.1%
1435.726667	1	< 0.1%
1377.077778	1	< 0.1%
1001.2	1	< 0.1%
931.5	1	< 0.1%
872.13	1	< 0.1%
743.8	1	< 0.1%

qtd_purchases
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	56
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.46887603

Minimum	1
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	4
95-th percentile	11
Maximum	206
Range	205
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	6.808862958
Coefficient of variation (CV)	1.962844131
Kurtosis	302.4748716
Mean	3.46887603
Median Absolute Deviation (MAD)	0
Skewness	13.20103788
Sum	19783
Variance	46.36061478
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2874	50.4%
2	829	14.5%
3	504	8.8%
4	394	6.9%
5	237	4.2%
6	173	3.0%
7	138	2.4%
8	98	1.7%
9	69	1.2%
10	55	1.0%
Other values (46)	332	5.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2874	50.4%
2	829	14.5%
3	504	8.8%
4	394	6.9%
5	237	4.2%
6	173	3.0%
7	138	2.4%
8	98	1.7%
9	69	1.2%
10	55	1.0%

Value	Count	Frequency (%)
206	1	< 0.1%
199	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	< 0.1%
86	1	< 0.1%
72	1	< 0.1%
62	2	< 0.1%
60	1	< 0.1%
57	1	< 0.1%

qtd_products
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	1840
Distinct (%)	32.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	977.833421

Minimum	1
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	1
5-th percentile	4.1
Q1	106
median	318
Q3	804
95-th percentile	2941.4
Maximum	196844
Range	196843
Interquartile range (IQR)	698

Descriptive statistics

Standard deviation	4425.980472
Coefficient of variation (CV)	4.526313354
Kurtosis	786.4421989
Mean	977.833421
Median Absolute Deviation (MAD)	253
Skewness	23.07183204
Sum	5576584
Variance	19589303.14
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	113	2.0%
2	73	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
12	25	0.4%
88	22	0.4%
72	21	0.4%
7	20	0.4%
Other values (1830)	5265	92.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	113	2.0%
2	73	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
7	20	0.4%
8	18	0.3%
9	7	0.1%
10	17	0.3%

Value	Count	Frequency (%)
196844	1	< 0.1%
80997	1	< 0.1%
80263	1	< 0.1%
77373	1	< 0.1%
74215	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
63312	1	< 0.1%
58343	1	< 0.1%

avg_products
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	2370
Distinct (%)	41.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	268.240499

Minimum	1
Maximum	74215
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	1
5-th percentile	4
Q1	75
median	152
Q3	290.7083333
95-th percentile	733.9375
Maximum	74215
Range	74214
Interquartile range (IQR)	215.7083333

Descriptive statistics

Standard deviation	1198.360557
Coefficient of variation (CV)	4.467485565
Kurtosis	2772.238185
Mean	268.240499
Median Absolute Deviation (MAD)	96.5
Skewness	48.56980066
Sum	1529775.566
Variance	1436068.025
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	114	2.0%
2	72	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
12	26	0.5%
100	22	0.4%
72	22	0.4%
73	21	0.4%
Other values (2360)	5262	92.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	114	2.0%
2	72	1.3%
3	51	0.9%
3.333333333	1	< 0.1%
4	49	0.9%
5	35	0.6%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6	29	0.5%
6.142857143	1	< 0.1%

Value	Count	Frequency (%)
74215	1	< 0.1%
40498.5	1	< 0.1%
14149	1	< 0.1%
13956	1	< 0.1%
7824	1	< 0.1%
6009.333333	1	< 0.1%
5963	1	< 0.1%
5197	1	< 0.1%
4300	1	< 0.1%
4282	1	< 0.1%

avg_unique_products
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1171
Distinct (%)	20.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	37.25704339

Minimum	0.2
Maximum	1109
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	0.2
5-th percentile	1
Q1	7.267857143
median	15.07692308
Q3	31
95-th percentile	173
Maximum	1109
Range	1108.8
Interquartile range (IQR)	23.73214286

Descriptive statistics

Standard deviation	76.83231525
Coefficient of variation (CV)	2.062222556
Kurtosis	32.93259067
Mean	37.25704339
Median Absolute Deviation (MAD)	9.923076923
Skewness	5.076421351
Sum	212476.9185
Variance	5903.204666
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	277	4.9%
2	161	2.8%
3	115	2.0%
9	105	1.8%
10	105	1.8%
8	103	1.8%
7	101	1.8%
6	101	1.8%
5	100	1.8%
13	97	1.7%
Other values (1161)	4438	77.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.2	1	< 0.1%
0.25	3	0.1%
0.3333333333	7	0.1%
0.4	1	< 0.1%
0.4090909091	1	< 0.1%
0.5	12	0.2%
0.5454545455	1	< 0.1%
0.5555555556	1	< 0.1%
0.5714285714	1	< 0.1%
0.6176470588	1	< 0.1%

Value	Count	Frequency (%)
1109	1	< 0.1%
748	1	< 0.1%
730	1	< 0.1%
720	1	< 0.1%
703	1	< 0.1%
686	1	< 0.1%
675	1	< 0.1%
673	1	< 0.1%
660	1	< 0.1%
649	1	< 0.1%

recency_days
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	304
Distinct (%)	5.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	116.8099246

Minimum	0
Maximum	373
Zeros	38
Zeros (%)	0.7%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	0
5-th percentile	3
Q1	23
median	71
Q3	199
95-th percentile	338
Maximum	373
Range	373
Interquartile range (IQR)	176

Descriptive statistics

Standard deviation	111.5190071
Coefficient of variation (CV)	0.9547048975
Kurtosis	-0.637244736
Mean	116.8099246
Median Absolute Deviation (MAD)	61
Skewness	0.8158475767
Sum	666167
Variance	12436.48894
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	110	1.9%
4	105	1.8%
3	98	1.7%
2	92	1.6%
10	86	1.5%
8	82	1.4%
17	79	1.4%
9	79	1.4%
7	78	1.4%
15	67	1.2%
Other values (294)	4827	84.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	38	0.7%
1	110	1.9%
2	92	1.6%
3	98	1.7%
4	105	1.8%
5	52	0.9%
7	78	1.4%
8	82	1.4%
9	79	1.4%
10	86	1.5%

Value	Count	Frequency (%)
373	23	0.4%
372	22	0.4%
371	17	0.3%
369	4	0.1%
368	13	0.2%
367	16	0.3%
366	15	0.3%
365	19	0.3%
364	11	0.2%
362	7	0.1%

purchase_frequency
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1226
Distinct (%)	21.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.5474289192

Minimum	0.005449591281
Maximum	17
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	0.005449591281
5-th percentile	0.01103144296
Q1	0.02496537396
median	1
Q3	1
95-th percentile	1
Maximum	17
Range	16.99455041
Interquartile range (IQR)	0.975034626

Descriptive statistics

Standard deviation	0.5504743093
Coefficient of variation (CV)	1.005563079
Kurtosis	138.7183578
Mean	0.5474289192
Median Absolute Deviation (MAD)	0
Skewness	4.848314544
Sum	3121.987126
Variance	0.3030219651
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2882	50.5%
2	48	0.8%
0.0625	18	0.3%
0.02777777778	17	0.3%
0.02380952381	16	0.3%
0.08333333333	15	0.3%
0.03448275862	15	0.3%
0.09090909091	15	0.3%
0.02941176471	14	0.2%
0.03571428571	13	0.2%
Other values (1216)	2650	46.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005479452055	1	< 0.1%
0.005494505495	1	< 0.1%
0.005586592179	2	< 0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	< 0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	< 0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
17	1	< 0.1%
4	1	< 0.1%
3	5	0.1%
2	48	0.8%
1.142857143	1	< 0.1%
1	2882	50.5%
0.75	1	< 0.1%
0.6666666667	3	0.1%
0.550802139	1	< 0.1%
0.5335120643	1	< 0.1%

qtd_cancelled_products
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	213
Distinct (%)	3.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	45.19480975

Minimum	0
Maximum	80995
Zeros	4200
Zeros (%)	73.6%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	38
Maximum	80995
Range	80995
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1468.516176
Coefficient of variation (CV)	32.49302705
Kurtosis	2760.820132
Mean	45.19480975
Median Absolute Deviation (MAD)	0
Skewness	52.07018364
Sum	257746
Variance	2156539.759
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4200	73.6%
1	169	3.0%
2	151	2.6%
3	105	1.8%
4	89	1.6%
6	78	1.4%
5	61	1.1%
12	52	0.9%
7	44	0.8%
8	43	0.8%
Other values (203)	711	12.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	4200	73.6%
1	169	3.0%
2	151	2.6%
3	105	1.8%
4	89	1.6%
5	61	1.1%
6	78	1.4%
7	44	0.8%
8	43	0.8%
9	41	0.7%

Value	Count	Frequency (%)
80995	1	< 0.1%
74215	1	< 0.1%
9014	1	< 0.1%
8004	1	< 0.1%
4427	1	< 0.1%
3768	1	< 0.1%
3332	1	< 0.1%
2878	1	< 0.1%
2022	1	< 0.1%
2012	1	< 0.1%

cancelled_over_purchased
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	1380
Distinct (%)	24.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.012446537

Minimum	0
Maximum	1
Zeros	4200
Zeros (%)	73.6%
Negative	0
Negative (%)	0.0%
Memory size	89.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.001084013706
95-th percentile	0.04119629874
Maximum	1
Range	1
Interquartile range (IQR)	0.001084013706

Descriptive statistics

Standard deviation	0.06760595652
Coefficient of variation (CV)	5.431708154
Kurtosis	128.7915174
Mean	0.012446537
Median Absolute Deviation (MAD)	0
Skewness	10.38988063
Sum	70.98260053
Variance	0.004570565357
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4200	73.6%
1	12	0.2%
0.01075268817	4	0.1%
0.009661835749	4	0.1%
0.009259259259	3	0.1%
0.5	3	0.1%
0.03846153846	3	0.1%
0.0243902439	3	0.1%
0.02380952381	3	0.1%
0.007462686567	3	0.1%
Other values (1370)	1465	25.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	4200	73.6%
0.0001169636243	1	< 0.1%
0.0001839926403	1	< 0.1%
0.0002816901408	1	< 0.1%
0.0003140703518	1	< 0.1%
0.0003619254434	1	< 0.1%
0.0003632401017	1	< 0.1%
0.0003637686431	1	< 0.1%
0.0003671071953	1	< 0.1%
0.000393081761	1	< 0.1%

Value	Count	Frequency (%)
1	12	0.2%
0.9999753077	1	< 0.1%
0.9863013699	1	< 0.1%
0.8333333333	1	< 0.1%
0.6333333333	1	< 0.1%
0.6115107914	1	< 0.1%
0.6008836524	1	< 0.1%
0.5964566929	1	< 0.1%
0.5648854962	1	< 0.1%
0.5646387833	1	< 0.1%

Auto

The auto setting is an easily interpretable pairwise column metric of the following mapping: vartype-vartype : method, categorical-categorical : Cramer's V, numerical-categorical : Cramer's V (using a discretized numerical column), numerical-numerical : Spearman's ρ. This configuration uses the best suitable for each pair of columns.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	customer_id	gross_revenue	mean_ticket	qtd_purchases	qtd_products	avg_products	avg_unique_products	recency_days	purchase_frequency	qtd_cancelled_products	cancelled_over_purchased
0	17850	5288.63	16.95	34	1733	50.97	0.62	372	17.00	40	0.02
1	13047	3089.10	15.92	9	1390	154.44	11.67	56	0.03	35	0.03
2	12583	6629.34	28.21	15	5028	335.20	7.60	2	0.04	50	0.01
3	13748	948.25	33.87	5	439	87.80	4.80	95	0.02	0	0.00
4	15100	635.10	105.85	3	80	26.67	0.33	333	0.07	22	0.28
5	15291	4551.51	42.14	14	2102	150.14	4.36	25	0.04	29	0.01
6	14688	5107.38	14.23	21	3621	172.43	7.05	7	0.06	399	0.11
7	17809	5344.85	84.84	12	2057	171.42	3.83	16	0.03	41	0.02
8	15311	59419.34	23.85	91	38194	419.71	6.23	0	0.24	474	0.01
9	16098	2005.63	29.93	7	613	87.57	4.86	87	0.02	0	0.00

Last rows

	customer_id	gross_revenue	mean_ticket	qtd_purchases	qtd_products	avg_products	avg_unique_products	recency_days	purchase_frequency
5693	22700	4839.42	78.06	1	1074	1074.00	55.00	1	1.00
5694	13298	360.00	180.00	1	96	96.00	2.00	1	1.00
5695	14569	227.39	18.95	1	79	79.00	10.00	1	1.00
5696	22704	17.90	2.56	1	14	14.00	7.00	1	1.00
5697	22705	3.35	1.68	1	2	2.00	2.00	1	1.00
5698	22706	5699.00	8.99	1	1747	1747.00	634.00	1	1.00
5699	22707	6756.06	9.25	1	2010	2010.00	730.00	0	1.00
5700	22708	3217.20	54.53	1	654	654.00	56.00	0	1.00
5701	22709	3950.72	18.21	1	731	731.00	217.00	0	1.00
5702	12713	794.55	21.47	1	505	505.00	37.00	0	1.00

Overview

Variables

Interactions

Correlations

Auto

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows